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GUIDE TO THE USE OF THIS MONOGRAPH 


The purpose of this monograph is to organize and present, for effective use in design, the signifi- 
cant experience and knowledge accumulated in development and operational programs to date. 
It reviews and assesses current design practices, and from them establishes firm guidance for 
achieving greater consistency in design, increased reliability in the end product, and greater 
efficiency in the design effort. The monograph is organized into three major sections that are 
preceded by a brief introduction and complemented by a set of references. 

The State of the Art, section 2, reviews and discusses the total design problem, and identifies 
which design elements are involved in successful design. It describes succinctly the current tech- 
nology pertaining to these elements. When detailed information is required, the best available 
references are cited. This section serves as a survey of the subject that provides background 
material and prepares a proper technological base for the Criteria and Recommended Practices. 

The Criteria, shown in section 3, state clearly and briefly what rule, guide, limitation, or standard 
must be considered for each essential design element to insure successful design. The Criteria can 
serve effectively as a checklist of rules for the project manager to use in guiding a design or in 
assessing its adequacy. 

Tire Recommended Practices, shown in section 4, state how to satisfy each of the criteria. When- 
ever possible, the best procedure is described; when this cannot be done concisely, appropriate 
references are provided. The Recommended Practices, in conjunction with the Design Criteria, 
indicate how successful design may be achieved. 

The design criteria monograph is not intended to be a design handbook, a set of specifications, or 
a design manual. It is a summary and a systematic ordering of the large and loosely organized 
body of existing successful design techniques and practices. Its value and its merit should be 
judged on how effectively it makes that material available to and useful to the designer. 
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SPACE VEHICLE DISPLAYS DESIGN CRITERIA 

1. INTRODUCTION 


This monograph is concerned with the guidance, navigation, and control (GNC) displays asso- 
ciated with manned flight. 

Flight guidance, navigation, and control tasks play a central role in accomplishment of space 
missions. These tasks make demands on the operator which can be categorized as follows: 

(1) Monitoring and decision making associated with the primary navigation and guidance 
process 

(2) Flight control and stabilization tasks 

(3) Sequencing and initializing of primary propulsion and timing systems 

(4) Perceptual and pattern-recognition tasks associated with celestial navigation, 

(5) Monitoring and, if necessary, operation of backup systems. 

Generally speaking, the displays available to the astronaut must enable him to answer four 
questions: 

(1) Where is the spacecraft with respect to the next flight goal or subgoal? 

(2) What is and what should be the velocity vector? 

(3) What is and what should be the vehicle attitude? 

(4) WTiat control actions are required to reach a desired vehicle flight state? 

The types of information required fall into three main categories: 

(1) Indication of state vector. Such a display, which is central to adequate flight control, indi- 
cates whether the space vehicle is in a flight configuration (position, direction, velocity) 
satisfactory to the next goal of the mission. 

(2) Status of subsystems. Such information indicates the state of those subsystems involved 
in flight control, 

(3) Computer-based displays. These displays may provide readout related to flight control on 
devices other than the more conventional flight displays. 

In the U.S, manned space program, the astronaut s need to use his display system has increased in 
order to guarantee the proper functioning of the system as the missions have become more com- 
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ple\ Man's most important function is In to mine more supervisory (ref. i). For critical functions, 
tlic crew mmt give continual attention to several levels of backup system In order that their status 
he known should their use heroine necessary. These bac kup systems tend to insure functional 
capability but place an increased burden on the crew’s attention. 

The fact that the astronaut still needs adequate* manual control capability has been amply 
demonstrated This has been true In the Apollo as well as earlier spacecraft. In fact, the manual 
control demands, when needed, in the more complex system exceeded those of the earlier 
systems. This has been particularly so in the lunar module landing phase. 


Completely automatic control has not been a design goal in manned space system design to elate. 
Rather, the de signs have been aimed at the use of human control inputs wherever they can simplify 
or improve the otherwise automatic operation. (For example, in navigation, the development of the 
sextant and the process of star tracking depended fully on human inputs.) 

There has been an increasing independence of ground control as systems base de veloped to the 
stage where the astronaut is capable of completing the mission with no aid from the ground. Tin's 
fac tor has increased the monitoring requirements placed on the astronaut hv the backup systems. 

Mission complexity and the allocation of tasks to human control and to automatic systems are im- 
portant factors in the determination of appropriate displays. It is also important to remember that 
other display functions can impose demands on the astronaut which may compete with these pri- 
mary displays of interest and, as such, must he considered in the design process. 


Our emphasis in this monograph will he upon the methodologies useful for determining the kind 
of information that must he presented and how this information should he organized. This will 
require discussion of appropriate systems analysis techniques. Wherever possible, appropriate* 
analytic methods for design and evaluation will be stressed. The monograph will not specifically 
consider implementation issues. Consideration of such fac tors as spec ific hardware details, relia- 
bility. and weight is regarded as being outside the scope of this doc ument, except as they relate 
directly to the information transmission qualities of the display. 


2. STATE OF THE ART 


The state of the art is established from actual flight and design experience obtained in the 
NASA Mercury, Gemini, and Apollo programs. Experience from modern aircraft made a signifi- 
cant contribution as a point of departure for the initial designs of spacecraft displays. Modern 
airc raft technology has also led to the development of displays that are more advanced than any 
incorporated in spacecraft so far. In future space vehicles, this advanced aircraft technology 
should he incorporated in vehic le designs. 

The following discussion presents the* interesting features of the displays of the three NASA 
manned spacec raft and appraises the methodologies used in their design and evaluation. A general 
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estimate of the display requirements for a range of missions in space flight is contained in refer- 
ence 2, 

Some general observations can be made of how man’s interaction with displays has developed. 
Apparently, mans most important role will continue to move towards that of a monitor of both 
primary and backup systems. By monitoring, it is meant that the man is not actively interacting 
with the system, but checks the state of the system, using the displays to evaluate whether a 
desirable situation is being maintained. However, particularly in more recent experience, it has 
been shown that with the system to date the astronaut is frequently called upon to play a very 
active direct role in system control. There is a continued requirement for manual-control capa- 
bility because during emergencies the man is called upon to control the system directly. The moni- 
toring of extensive backup systems, which are provided to insure system reliability, can require 
maintenance or continual attention by the astronaut, which add considerably to his task load. 


2.1 Mercury Space Vehicle Displays 

Reference 3 provides a general description of the design of the displays for the three spacecraft 
systems. In figure 1, the Mercury spacecraft main display panel is shown and the principal GNC 
displays are outlined. This first manned spacecraft used displays similar to, but less complex than, 
those then used in advanced aircraft. Actual aircraft instruments were used with some simplifica- 
tion and miniaturization. Some of the design techniques emerged out of earlier work performed 
on the Dynasoar project. The critical display issue in Mercury was the need for adequate pres- 
entation of information to the astronaut during retrofire. 


The Mercury spacecraft had no independent gyro horizon or flight director system; instead, the 
constraints of power availability and reliability resulted in attitude data being displayed on three 
galvanometers indicating separately roll, pitch, and yaw, with three additional needles providing 
information on the three attitude rates. This attitude display was of prime importance to the suc- 
cess of the mission, and considerable attention was devoted to its design. The final design de- 
parted from standard aircraft practice in that it displayed information coded in “fly-from” form 
rather than “fly-to,” 


By “fly-from,” we refer to the situation where the moving element of a display indicates the de- 
parture from the required position, rather than indicating the position to which the vehicle is to 
be oriented. Considerable discussion has been devoted over the last 20 years to the most desirable 
procedure for coding orientation information. Although the Mercury system was a departure from 
normal aircraft practice, it was a successful design and yielded desired performance. The atti- 
tude control task was simplified by using a “quickening” technique (discussed later) where the 
attitude position and attitude rate pointers were so positioned on the display that the optimal 
control procedure was to keep the pointers aligned. The panel was organized according to func- 
tion. On the center panel with the attitude display was an altimeter and a rate-of-descent indi- 
cator, The altimeter also represented a departure from current practice in that it was a 
single pointer display with a logarithmic scale. Environmental and other subsystems were sep- 
arated from flight displays and were mounted on the right-hand panel. 
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BACK OF PANEL 


BEHIND PANEL 


Figure I.— Mercury spacecraft niniii r1isj-»l:i y panel. 


A workload analysis was carried out on tlir Mercury system, using time-line analysis which was 
mainly performed liy band, without computer simulation. Because the mission was a restricted 
one. the postulation rtf possible failures during the various stages* of flight was a manageable 
problem. For a detailed description of the types of analyses performed, see reference 4. Actual 
performance evaluation was carried out in the simulator, where the operational situation was de- 
graded by subjecting the displays to "blanking'" at regular intervals (ref. 5). 

The most demanding task that would he carried out l»v the astronaut was the need to counteract 
a perturbing torque during retrofire in manual control mode. Tin- analysis showed that the hand- 
ling of the three-axis retrograde problem required nearly K)0 percent effort from the astronaut 
for a maximum time of 30s. Since this* task was the most difficult, it was used as the determining 
factor in the design of the attitude display. It was found that attitude display and use of attitude 
rate information were much more important here than the display and use of the actual attitude 
angles 
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Control stick design and location were also carefully considered for the Mercury project. One line 
of thought suggested that the best control-display compatibility relationship would be achieved if 
the control stick were aligned to correspond with the axes of the spacecraft. The second approach, 
which was followed, was to maintain maximum similarity to the conventional aircraft cockpit. The 
astronauts were all skilled pilots, and it was considered desirable to maximize the transfer of habits 
from the cockpit to the space cabin. As a result, the attitude control was oriented as in a conven- 
tional aircraft cockpit. 


2.2 Gemini Space Vehicle Displays 

Although the Mercury attitude display system was different from standard aircraft displays with 
regard to quickening and “inside out,” the Gemini system tended toward standard aircraft prac- 
tice, Gemini incorporated a Flight Director Attitude Indicator (FDAI) like an aircraft gyro 
horizon and included the standard three-pointer altimeter. 

The display panel design was much more complex than that found in the Mercury system, as can 
be seen in figure 2, where the principal GNC displays of the command astronaut are outlined. 
The Gemini’s requirement for rendezvous and docking maneuver in space meant that much more 
information had to be provided the astronauts and that some nonaircraft displays had to be 
included. Workload analysis showed that the rendezvous procedures constituted the most critical 
task demand of the mission. Incremental velocity indicators were added to show &V values in all 
three axes. In addition, there was some duplication of basic mission instrumentation, such as an 
FDAI for both astronauts’ panels. This added increased reliability and ease of use. 

In Gemini, the first manned spacecraft to have a digital computer on board, a computer display 
and keyset -were contained in the second astronauts panel. Duplicate primary flight instrumenta- 
tions were located in front of each astronaut, but there was no duplication of subsystem displays: 
these were located between the two astronauts so that either could have access to them. 


2.3 Apollo Space Vehicle Displays 

By far the most sophisticated manned space vehicle to fly to date has been the Apollo, This 
sophistication is reflected in its display system illustrated in figures 3, 4, and 5, Prior to Apollo, 
manned spacecraft had all the displays located within a continuous panel area. In the Apollo 
command module, the main display console (shown in figure 3, with the main control displays 
outlined) and the guidance-navigation display panels (figure 4) are located separately. In figure 
5, the principal control displays are outlined for the lunar module. The Apollo main display con- 
sole (fig, 3) contains flight-control, engine, communications, computer, and other subsystem dis- 
plays. A map and data viewer was considered for navigation but ultimately Was ruled not to be 
necessary for the mission. The guidance and navigation panel, the scanning telescope, and the sex- 
tant allow' the celestial position to be measured automatically. The display and the keyboard as- 
sembly (DSKY) for the Apollo guidance computer are located in both the main display console 
and the navigation display panel, and provide a significant opportunity for mutual interaction of 
astronaut-controlled and computer-controlled systems. The DSKY played an important role in 
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Figure 2.-P«-!,iii rtf Gemini sjvH-cnuft display and control panel 


fliglit control in several phases of tlie flight and constituted the most important aclvanremen! in 
tin* display-control area over previous systems. The command module contained two FDAT, 
which were more sophisticated in design than the one used in Gemini. This newer FDAT, which 
also included display of attitude rates, was designed so that fuel use during maneuvers could he 
minimised. 


A great deal of deliberation preceded the decision to observe current aircraft practice and utilize 
fly-to or "inside-nut* displays. After initial reservation (possibly due to lack of familiaritv with 
the display!, astronaut acceptance was finally high for this display. The Apollo Command Module 
utilized a "g-traec* display” for re-entry. 



Figure 3,— Apollo spacecraft main display console (Command Module): (a) left display panel; (b) center 
display panel; and (e) right display panel 
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Iii the !mi:ir module for tin- Apollo system, the two-man craft contains considerable redundancy 
of flight control displays (see figure 5), Each astronaut in flic lunar module is provided with a 
gyro horizon and fore-and-aft and right-left velocity indicators. The gyro horizon was slightly dif- 
ferent in design from that used in the command module FDAI to suit the particular requirements 
of the lunar landing. It was intended that interaction would occur between the astronaut and the 
computer via the I)SK Y and the translation control stick during the lunar-landing phase. The com- 
puter provides active closed loop control of the attitude and velocity vec tor while also accepting 
the desired changes from the astronaut. 


In the design of operational procedures, sequences of events were organized so that the crew 
could maintain virtually complete control of each part of the sequence, or, where the on-hoard 
computer system exercised automatic control, the crew could he an integral part of such auto- 
matic sequencing and could monitor and take over control if nercssary. 


An important reduction of crew workload was achieved by having a considerable system moni- 
torin': load maintained by ground control. Tins meant that it was not always necessary for the 
crew to maintain watch over their display system, and thus allowed the possibility of leas ing 
the lunar module unattended while both crewmen carried out exploration of the Moon on font, 
Dt spin- this ground monitoring capability, one rule established early in the Apollo development 
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was licit il should lit* possible to complete tin* mission with no aid from ground control. Tin's 
meant licit tin- display systems had to 1»<* aide to supply all needed information. Another ground 
rule that afh-eted development of the display system was that a solitary crew member should 
be able to perform all the functions required to return safely to earth from any point in the 
mission. 


Many different modes of flight control were developed to cope with various emergency situations. 
For example, in the Apollo attitude control system, nine different modes were developed. Each of 
these modes represented a different level of man -machine interaction; that is - , the* amounts of 
information processing required differed for display using manual control and for display using 
automatic computer control. 


The Apollo display system, despite the ability of the craft to maneuver in space relatively indepen- 
dently of communication with the ground, was not required to display multiformatted pictorial- 
type sensor displays. In fact, on-board navigation data came only from three sensors in addition to 
inertial guidance. The navigation sensor data came only from visible optic s and VIIF radio range 
in the command module, and from radar (for altimetry, rendezvous range, and angle tracking! 
in the lunar module. 


2.4 Important Developments From Advanced 
Aircraft Systems 

Much of the modern aircraft display technology that has developed over the last decade has not 
been included in any of the manned spaeecraft. For example, in aircraft, the cathode ray tube 
(CUT i is being used increasingly, partic ularly in military airc raft. However, powe r limitations and 
the* need for very high reliability led to the decision not to use such devices in advanced space- 
craft. There have been several important developments that will have implications for future 
spacec raft displays; pictorial. CHIT, and head-tip displays. 


The most recent deve lopments in modern displays* have been made in pictorial presentation. Con- 
tact analog, head-up. and helmet-mounted displays are examples. (By pic torial is meant that 
type of display which presents a spatial analog of the real world and the relationship of the 
vehicle to its environment ! In the past, these displays have been static, in the form of printed 
maps or graphic road sign displays, but in aircraft, pic torial displays are most useful where they 
are dynamic*, whe re the display is a substitute for a direc t view of moving system elements wi.bin 
the operational environment. A visual pictorial display usually results from the mapping of rele- 
vant selected aspects of the* refe rence space to the display space by a simple* transform. This 
transform is usually veridical, in that it preserves most of the- spatial and temporal relationships 
between svsti-m elements. 


In providing such mapping, various degrees of realism arc* achieved. A full-color photograph is a 
nearly veridical display, whereas a map is more of an abstraction. Frequently, a pictorial display 
can provide more information than is used for normal operations, with the additional information 
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available as needed. This allows flexibility in manned operation, which is difficult to achieve with 
symbolic or numerical displays. 

Another desirable characteristic of pictorial displays is their capacity to display a number of vari- 
ables simultaneously in a coherent frame of reference. Displays with this property enhance the 
ability of the operator to detect a failure in an automatic system by presenting him with an inte- 
grated, well coded means of monitoring system performance. 

Experimental evidence has usually indicated the superiority of pictorial displays over conventional 
displays for flight control functions (refs. 6 and 7 ), probably because information is presented in a 
way consonant with normal perceptual experience and in highly redundant form. Both character- 
istics tend to allow rapid interpretation and to suppress erroneous interpretation. 


For aircraft, two types of pictorial displays have developed (ref. 6): flight control displays (vertical 
situation displays), and navigation displays (plan position indicator, map or horizontal situation 
displays). A map display presents information concerning the ultimate goals of flight (such as 
destination) and is suitable for establishing subgoals (such as desired heading, altitude and speed). 
Backed by a suitable guidance system, a map display also allows maintenance of continuous geo- 
graphic orientation. Its potential for application in space is supported by the fact that the Russian 
manned spacecraft Vostok had such a device. 

Another dramatic change that occurred in the development of pictorial displays over the last 
decade was the acceptance of the CRT as an on-board aircraft display device. A CRT was 
first used for flight control in the A6 aircraft, and since that time it has been widely used in mili- 
tary aircraft. References 8 and 9 provide appropriate material on this topic. 

The developing use of the CRT has resulted from the increased use of remote image-forming sen- 
sors such as radar, infrared, television (including low-light-level TV), and laser. Many missions 
require the display of several different types of sensor data. The outputs of several sensors, each 
with a different format and frame rate, are usually displayed on a single time-shared display. 
Time-shared displays are required because the limited usable space for sensor displays in tac- 
tical aircraft cockpits generally does not allow for separate displays. In addition to sensor informa- 
tion, computer-driven symbology for aircraft steering is often simultaneously presented. A num- 
ber of alternative display devices have developed, such as Direct View Storage Tubes, Multi-mode 
Tonotron converters, and Scan converters, all of which use TV presentation to the human oper- 
ator (ref. 10). Device selection depends on the specific operational environment. 

Various systems of three-dimensional displays have been developed, both stereoscopic and volu- 
metric. However, such displays do not offer enough advantage at present to compensate for the 
additional complexity and related problems. 

Recently, there has been an increased emphasis on maintaining visual attention outside the cock- 
pit. Although most integrated displays contribute to a reduction of the “within-panel” scanning 
load, other related flight display problems have been experienced. There has been a growing rec- 
ognition of the need for the pilot to maintain his gaze continuously out of the cockpit at the flight 
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path ahead particularly on takeoff and approach to landing and under marginal visibility con- 
ditions, (Obviously, the necessity for dividing attention between the instrument panel and the 
external world reduces the amount of attention available for external scanning.) Although the time 
required to re-aceommndate from outside the cockpit to the instrument panel, read an instru- 
ment, and then return to viewing the external scene will vary with tin- situation, one experimental 
estimate was 2,5 seconds (ref, 11). This transitioning constitutes a significant loss in the time 
available to the pilot for processing visual information. 

One solution to tin's problem is the “head-up" display. Such displays project needed flight pa- 
rameter information onto the pilot’s windshield so that he can maintain attention on the flight 
path abend and have flight display information immediately available. The projected display Is 
collimated to allow the pilot to maintain visual focus at infinity. Considerable development has 
been devoted to this type of display. An alternative form of tin's development is the helmet- 
mounted display utilizing a small CRT and appropriate* optical system. With such displays in- 
formation ran he presented to the pilot continuously no matter what the* orientation of his head 
relative to the axes of the aircraft. Having achieved relatively high brightness levels and low 
weight, these displays appear to he a feasible alternative. Such a display also provides a simple 
means of displaying added information to the pilot where it is not possible to fit an added dis- 
play to the instrument panel. 


2.5 Display Principles 

A considerable amount of handbook data on the specifies of display design has hern developed 
since the late 1910s. particularly for symbolic displays. Such detailed design information is con- 
tained in several texts and handbooks. A good genera! reference is the Human Engineering Guide 
to Equipment Design (ref. 12). These handbooks supply information about what constitutes good 
design practice for displays that must provide quantitative, qualitative, and check readings. 

Of more interest, however, to the designer of flight control displays are the more general de- 
sign principles that have evolved through design and operational experience. These relate to 
logical rules for grouping related information into integrated displays, as well as to principles 
for encoding information for case of interpretation and control. A similar set of principles is dis- 
cussed in detail in reference 13; the principles ami their underlying significance are briefly de- 
scribed below. 


2.5.1 Task Hierarchy 

The tasks that a pilot performs can he hierarchically organized. An aircraft pilot can exert control 
at a number of levels. He can control just one parameter of flight or operate at a higher level and 
control several parameters simultaneously. Higher-level tasks usually comprise a series of more 
specific, lower-level tasks. Tills fact makes possible the logical grouping of information into a 
relatively small number of integrated displays or into a small number of groups of displays. If 
possible, hierarchically related information should he presented in a common frame of reference 
or coordinate system. 
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2.5.2 Display Integration 

In an integrated display, a number of related information items are combined and presented in a 
common reference system that -allows the relationship between items to be perceived directly. 
Simply combining information items into a single display without a common reference unit does 
not result in an integrated display. Map displays in aircraft are one of the best operational exam- 
ples of integrated displays; they yield superior flight-path control compared with the perform- 
ance obtained using the standard non-in tegrated navigation displays. How far this integration 
process should be carried represents a major problem. Some flight parameters, for instance, 
must be present in accurate quantitative terms for stable operation, and it is not always reason- 
able to make such a presentation within an integrated display. Separate long-scale symbolic or 
digital readout displays are thus required; although it may be necessary to separate them from 
the integrated displays. 


2.5.3 Pictorial Realism 

The information content of a display should be encoded so that the symbols can be readily as- 
sociated with the information items that they represent. The spatial relationships among the 
symbols on the display should be undistorted analogs of those in the physical world that the 
display represents, Tor instance, altimeters having vertical scales that are pictorially realistic- 
in that up means up and down means down in terms of the aircraft’s position and motion in 
space— are superior for check reading to circular displays, which represent a spatial distortion 
(ref. 14). 


2.5.4 Coordinate Systems 

The element that the operator perceives as moving in a display should correspond to the element 
that is moving in the real world. Over the years, the most controversial issue in flight display de- 
sign has been the question of what moves— the airplane or the outside world. In an analysis of 
pilot errors (ref. 15), a high incidence of errors resulted from reversal of instrument sensing, par- 
ticularly with the attitude display. 


Either of two basic coordinate systems may be used in a display. Spatial flight information may 
be displayed in Earth coordinates or aircraft coordinates. Earth coordinates refer to those that are 
fixed relative to Earth (for aircraft) and are frequently referred to as “outside-iri” or “fly-fronT 
designs. Aircraft coordinates which can be called “inside-out” or “fly-to” systems, give a represen- 
tation that corresponds to the view that the pilot obtains from looking through his windshield at 
the Earth. 


However spatial information is presented, the most critical feature of the display is the need 
to convince the human that the vehicle in which he is located is actually moving in space. When 
the outside world is perceived as moving, the pilot becomes disoriented and is subject to vertigo. 
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Such a faKr perception ran sometimes occur with displays bum! upon aircraft coordinates, If 
detail is added to tin* aircraft coordinate display to mala* it pictorially more realistic, this- prob- 
lem of vertigo t an often be reduced. 

In general, since visual displays transmit information in large part by motions of elements within 
the display, a consistent and natural set of movement relationships must be chosen in order to ob- 
tain optimal performance from the human. This is a central problem in the design of visual dis- 
plays. To have a conflict between the movement relationships has been found to cause a degrada- 
tion in performance fref. 16'-. In fact, it appears that it is hi tter to have a consistent set of unnat- 
ural movement relationships than a combination of natural and unnatural movements. 

2.5.5 Scaling 

The scale fac tor chosen for a display should show as much of the total situation as possible while 
still being sensitive enough to allow the required precision of control Selection of an optimum 
scale fac tor requires studying a series of tradeoffs. In general, there is an optimum scale factor 
for performance. As the scale factor is increased, precision of control improves up to some point 
at which the indicator movements exceed the dynamic range of the display, and then per- 
formance* degrades. A performance cost may lie involved in achieving added precision: as the* 
scale factor is increased, the human operator often works harder on the control task and does 
this at the expense of atte ntion to other tasks fref. 17 *. Thus, improving performance* by increas- 
ing gain on one* display may lead to degraded performance on other tasks. Appropriate scab* fac- 
tors. thr-n should he determined by fl» the level of accuracy that is required in controlling the* 
displayed flight parameters and (2i the indic ator move ments that will result. 

In displays that include rotation of a pointer on a circular scale, ce rtain pointer positions are 
ambiguous* because the direc tion of increase can be interpreted in either rectilinear coordinates 
or polar coordinates (e g.. 9 o'clock pointer position is superior to 3 o'clock or 6 o’clock positions'. 

2.5.6 Control Task Simplification 

Research on manual control of high-order systems has provided techniques that lead to a re- 
duction in the difficulty of the task for the pilot. Many of these* procedures are based on display- 
ing additional vehicle state variables to the pilot or on combining these state variable s into a 
command indication to the pilot. 

‘Quickening" is an example* of the latter technique. A linear sum of state* variables, usually simple 
derivative terms, is formed and displayed so that the operator does not have to sense and utilize 
derivative information separately (ref. ISA The displayed quantity constitutes a command, usually 
an error, that is to be nulled. A quickened display can also be used to facilitate instrument moni- 
toring performance (ref. 19'. 

Tin* attitude control display in the* Mercury Capsule was a partially quickened display. The* in- 
strument actually used had cross pointe rs in the middle to indicate attitude*, phis additional 
pointers to indic ate rate* of change of attitude. The astronaut c-ould take advantage of the align- 
ment of the attitude and attitude-rate needles to obtain a stabilized display. Other instruments 
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have cross pointers in the middle and indicate attitude only. The current flight-director indicator 
aboard civil airliners constitutes another type of quickened display where deviation and the rate 
of change of deviation yield improved performance over the earlier cross-pointer instrument, 
which only indicated actual deviation from the desired flight path. 

There is a possible limitation associated with quickened displays. A quickened display does not 
provide the operator with explicit information regarding the current condition of the system, and 
hence is of limited usefulness for monitoring the state of the system. Quickening does not have 
any appreciable advantage in systems where there is no delay or dynamic lag in the controlled 
element. 

Modern flight director instruments provide both status information and effectively quickened 
command signals made up of an appropriate intermix of vehicle motion and guidance command 
quantities (ref. 20). 

To reduce the workload on the human operator or to achieve stability, a display can be used with 
complex control systems to present future states of the vehicle in prediction displays (refs. 21, 22), 
To display such information, a fast-time model is operated repeatedly on an accelerated time 
scale and repetitively computes predictions of the real system’s future based on an assumption 
about what the operator will do with his control. The predictions so generated are displayed to the 
human to enable him to reduce the difference between the predicted and desired output of the 
system. 

2.6 Implications of Aircraft Display 
Development for Spacecraft Displays 

Recent aircraft design and operational experience has shown that time-shared literal CRT-type dis- 
plays are feasible. Although they may not yet be as reliable as electromechanical displays, CRT 
displays are dependable enough to represent an alternative to more conventional displays and to 
offer a superior and a more flexible means of presenting some types of display information. 
Further, the use of such displays can save panel and cabin space. 

The flight control, guidance, and navigation process in spacecraft should benefit from the use of 
variable-format pictorial displays, particularly for critical maneuvers such as power descent and 
landing— maneuvers that require accurate control of space- vehicle attitude and approach to a goal. 
In aircraft, pictorial displays given by an airborne computer can facilitate flight control and naviga- 
tion, Additional computing capability aboard a spacecraft would permit considerably more flexi- 
bility in the type of information that could be displayed. 

The general display principles that have developed out of aircraft experience should hold, for the 
most part, in spacecraft flight control applications. These principles apply largely to pictorial dis- 
plays. In choosing the elements in a display that should move, one can expect some differences 
between aircraft and spacecraft. In space flight, the Earth reference should not be as strongly 
established nor as relevant as it is in aircraft flight. Furthermore, the competition experienced on 
occasion hy pilots between vestibular feedback and visual display indications can be expected to 
undergo a fundamental change because of the weightless condition experienced in space. 
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2.7 General Methodology of Display Evaluation 

Despite t li r- large amount of literature on display design and evaluation, a fully standardized 
methodology for a program of evaluation has not emerged, either in aircraft or spacecraft dis- 
plays, P roll able reasons for this lark of standardization arc: 

(11 The required vehicle guidance information and displayed information 1s so situation- 
specific that generalities have hern difficult to catalog 

(2) The responses to specific display indications depend on the overall situation and on the 
operator’s taslc load 

(3) It is difficult to determine the minimum or optimal information requirements that will he 
appropriate for the operational needs 

(4) Extrapolation to operational conditions from the data obtained in simulator studies is 
always risky 

(5) There is a lack of system effectiveness measures upon which measures of display effec- 
tiveness can he obtained and utilized 

(6) Real display differences may he obscured by the experimental variability arising in com- 
plex simulator testing 

(7) Frequently, display design is selected on the basis of several factors other than human 
factor requirements and formal analysis. Design of previous systems, panel spare, engi- 
neering feasibility, available hardware, reliability, and user acceptance are all important. 


Information requirements are generally determined by examining, in turn, the mission require- 
ments, the system functions, the crew functions, performance criteria, and the specific data the 
crewmembers need to carry out (lieir particular tasks. However, the content of information re- 
quirements ran vary considerably when different formulations are contrasted. There seem to he 
differences of opinion among analysis experts (ref. 6>, Actually, no set of information requirements 
is exhaustive as a result of analyzing the display needs, because some of the information the 
human operator requires is obtained through training and is never explicitly displayed to him. 
One may conclude that a list of information can be used only partially as a basis for deciding 
which information to include in displays and the best way of encoding this information. For a 
technique that alleviates some of these problems for flight control displays by using a systematic 
procedure based on control theory, see reference 23. 


In evaluating display systems, simple experiments have been used inappropriately, in that they 
result in design judgments that might have been different if other experiments contrasting com- 
peting display designs bad been carried out. Experiments are frequently essential in the process of 
developing a display design. However, experience lias indicated that, if studies are not complex 
enough, negative results ran be obtained that indicate no difference in error performance amonc 


16 



competing subsystems, although actual differences in workload do exist. Another experiment using 
a task complexity similar to that of the actual operational situation may have yielded statistically 
significant differences between the displays considered (ref, 24), 

Essentially, the problem is one of increasing tbe sensitivity of measures of the operator’s perform- 
ance (such as his error rate, workload, and reliability), so tbat the probability of accepting the 
experimental result of “no differences” is reduced. There is a real need to improve experimental 
sensitivity to a level capable of demonstrating even small differences between competing subsys- 
tems, When an operator is concerned only with a simple subsystem, adequate performance may 
be obtained. However, in the complex situation of the operational system, particularly under 
emergency conditions, any deficiencies in a display could be important. This puts a premium on 
the selection of the best subsystems. 

Experience also shows that personnel selection procedures or extensive training do not seem to 
compensate completely for an inferior system under the degrading effects of stress (ref, 25), This 
further supports the need for control display analysis prior to selecting the appropriate experi- 
mental complexity when evaluating displays. 

Previous experience in evaluating displays has also indicated how much the experimental results 
depend on the method of testing. Experimental performance measures sometimes do not reflect 
the appropriate psychological dimension, A study can yield statistically significant differences be- 
tween the quality of the displays being compared, but the scores may not be valid indicators for 
deciding between competing approaches (ref. 26), The limitation of performance measures taken 
out of context and not relevant to operational situations is important to take into account. 

In this respect, carrying out a series of evaluation tests has been shown to be appropriate; reliance 
should not be placed on a single level of evaluation. In fact, a hierarchy of tests and a variety of 
measures designed to evaluate different display aspects may be appropriate, such as preliminary 
screening, static open-loop tests, dynamic open-loop tests on single displays, dynamic tests in 
simulators, and dynamic flight tests, where each is applied systematically at different stages of 
system development. Examples in the literature (for example, ref. 27) have shown the importance 
of inter-task compatibility: how well can performance on the various displays be combined, and 
how do the different demands interface under concurrent performance conditions? 

In laboratory evaluation of displays, information-extraction measures are those most usually ob- 
tained by the experimenter. For example, performance scores dealing with speed and accuracy of 
reading (legibility) or tracking error are those most frequently used in evaluation. Although these 
scores have good face validity in that they reflect how efficiently the display transmits information 
to the human, this type of procedure has been criticized in that it does not take account of the 
more complex decisions that the human must make in using information from the display, A dif- 
ferent type of laboratory criterion (ref, 28) that has been used as a test for display effectiveness 
takes into account decision quality, or how well the operator can use the displayed information. 
Experimenters using simulations of complex-decision situations have shown that little relationship 
exists between traditional measures of information extraction and the measures of decision effec- 
tiveness— which indicates the possible importance of this added dimension in display evaluation. 
Decision quality apparently depends heavily on how the information is coded and its com- 
patibility with the type of output required. 
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2.8 Methodology Used in Spacecraft Display 
Evaluation 

In all three spacecraft, workload estimates using time-line analyses were performed on the whole 
system. The term “time-line analyses” refers to the technique of task analysis where charts are 
developed by plotting sequentially each task element and its time of occurrence. The series of 
tasks is dictated by the mission analysis and the information requirements. These diagrams then 
portray in fine detail the subtasks imposed on the operator as specified by observable events. Such 
diagrams show how the taskload on the operator varies over time. 

Most of such workload analysis was performed on the Mercury system using hand analysis (ref, 4) 
as well as some computer simulation, but with later spacecraft the analysis was more extensive, 
involving very detailed computer simulation. With all three spacecraft, analyses were performed 
postulating large ranges of possible system failures and contingencies, and the consequent patterns 
of astronaut activity were analyzed for possible work overload situations. Workload estimates 
were made for all stages of flight, considering many possible degraded system modes. These esti- 
mates of man-machine capability played important roles in the design process, in that they per- 
mitted estimates to be made of man-machine capability prior to full task simulation (refs. 37 and 
38; see also ref. 39 for a general article on these types of techniques). Estimates of workload were 
not taken to represent exactly that which would be experienced during actual flight, but rather 
the estimates allowed a priori comparison of various display configurations with one another by 
an internally consistent method, taking the range of astronaut subtasks into account. 

Workload estimates from the time-line diagrams were based on the percentage of time the astro- 
naut was occupied in a sample interval, compared with the time available, which yielded time- 
varying estimates of workload as the mission proceeded, A general rule of thumb has developed 
in estimating what constitutes acceptable workload levels, the rationale being that high work- 
loads lead to situations in which errors in task performance increase markedly. Experience has 
indicated that, during active performance by an astronaut, he should be kept 60-70 percent occu- 
pied in order to obtain the most consistent performance (ref, 40), At workloads higher than this 
figure, errors in task performance can be expected to increase markedly. This type of analysis 
showed that on the Mercury system, for example, the astronaut could be 100 percent occupied 
for brief periods of time, although the task loading was much less than this throughout most of 
the mission. 

The Apollo mission requirements were frequently altered and refined as the system was being 
developed. This made possible a flexible approach to task analysis through the use of the com- 
puter to synthesize a time-line diagram from the series of discrete tasks and to develop a com- 
posite workload by applying a simple set of strategies to schedule tasks for minimum workload. 
This approach also considered task priority (by which certain tasks would take precedence over 
others) and task assignment by crew member. Initial allocation of tasks among the three crew 
members in Apollo was done informally on a relatively ad hoc basis. This allocation was then 
modified along with the information requirements and the occurrences of each task in time as dic- 
tated by the mission analysis. Various iterations were checked and the final allocation verified by 
the results of time-line and workload analysis. 
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2.9 The Use of Analytical Models 

2.9.1 Role of Analytical Models 

Analytical models of pilot-vehicle systems may be used to provide a preliminary evaluation of 
competing display configurations without the necessity for complex simulators and in-flight 
studies. These models allow the designer to take a systems approach to several aspects of display 
design and development. It is possible to consider vehicle dynamics, disturbance, mission criteria, 
and human capabilities and to determine analytically the way in which these factors interact with 
the type and quality of displayed information in terms of overall system performance. 

Studies of human monitoring and control behavior that have been performed to date have yielded 
a sizable data base from which we may infer general, quantitative relationships between model 
parameters and parameters of the control environment. We can, therefore, use existing pilot- 
vehicle models to predict system performance and pilot behavior for various control systems and 
display configurations not hitherto investigated. This is important, because the suitability of a 
given display configuration is highly specific to the nature of the control task. 


2.9.2 Brief Description of the Models 

Quasi-linear models of pilot-vehicle systems have been developed to a high degree, and we con- 
sider models of this type to have the greatest potential with respect to evaluation of displays. In 
these models, the pilot is represented by a linear response element (the pilot-describing function) 
plus a “remnant" term (to account for the portion of his output that cannot be accounted for by the 
describing function). Model parameters are most readily interpreted when the vehicle dynamics 
are linear and when the statistics of the control environment are time-stationary. The appropriate 
pilot strategy is to behave as a linear, time-stationary controller. The describing function may 
then be interpreted as the deterministic linearized portion of the pilot’s strategy, with the remnant 
representing purely stochastic behavior. If instrument scanning is required, the pilot’s monitoring 
strategy (and possibly his control strategy) will be time-varying. Quasi-linear pilot-vehicle models 
may be usefully applied to situations of this type as well, but measurements of pilot remnant will 
reflect the time-varying nature of the pilot’s response strategy as well as truly “random” behavior. 

Quasi-linear models fall into two basic categories: the frequency-domain representation (ref. 44) and 
the state-variable (or “optimal-control”) model (ref. 45). Both representations allow one to pre- 
dict pilot-describing functions and measures of overall system performance such as mean-squared 
system error. There are, however, considerable differences in the computational techniques em- 
ployed by these two types of models. References 44 and 45 provide detailed descriptions of these 
models. 

Both kinds of pilot models contain elements that may be identified with specific physiological or 
psychophysical functions. The frequency-domain models, for example, often include specific repre- 
sentations of the neuromuscular system. On the other hand, the state-variable model represents 
the pilot's estimation and control strategies as distinct elements. 
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Fr«quenr-y-d«»m:»in and state-variable pilot vehicle models may both lie profitably applied to tlic 
area of display evaluation. In tin* remainder of this sec tion, tin* specific potential capabilities 
of tie ' models is outlined. 


2,9,3 Specific Capabilities of Analytical Models 

File' vehicle model' have reached the stage of development at whic h (hey may hr used to ex- 
plore the aspec t s of pilot behavior and system performance described hrlmv. 

(1) Total System Performance 

For situations in whirls tie* vehicle dynamics can he* linearized and the mission requirements repre- 
sented tmamhigunmly in a suitable mathematical form, analytical models may he* used to predict 
overall syst< m pe rformance. Thus, these models can he used to determine the* extent to which 
mission requirements c an he met with a given display configuration. By noting the effects on sys- 
tem performance of changes in one or more display parameters. (!> determine the information 
requirements of the system (2't determine improvements associated with display quickening and 
predictions, and f,T compare* the relative merits of command information versus error informa- 
tion. Considerable modeling suc cess has been obtained in this regard, and the model can now he 
applied with reasonable confidence to the problem of predicting overall system performance and 
how the performance c hanges with modific ations to the display. 


(2) Pilot Response Behavior 

Tin input output hehavior of the pilot {he., the combined perceptual, central- processing, and 
control behavior's is predictable. The response strategy is usually presented in the form of a 
describing function {or set of describing functions!. Comparison of predicted behavior with 
response strategies measured in "conventional” flight-control situations will indicate whether or 
not an unusual response strategy is demanded by the system under investigation. Considerable 
success has been obtained in predicting pilot-describing functions in a variety of control situa- 
tions; hence, applications of this sort are warranted. 


(3) The Pilot's Estimation Strategy 

fi.e pilots estimation strategy ran be predicted for situations in which the pilot acts as a monitor 
only. A model of this sort is quite valuable In predicting system transients that occur when the 
mode of control switches from automatic to manual. 


(4) Pilot Workload 

Models have been developed which appear capable of predicting scanning workload, he., the 
fraction of attention that tin* pilot will devote to the various displays {ref. 4C>\ Models have been 
applied to systems containing physically separated displays as well as those in which a single 
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multielement display has been used. In addition, a model has been developed to predict central- 
processing workload, i,e,, the amount of attention that must be devoted to the task as a whole in 
order for mission requirements to be achieved (ref. 47). 


(5) Instrument-Related "Noise" 

The state- variable model contains a set of parameters associated with perceptual noise. To some 
extent, these parameters may be adjusted to account for the effects of random disturbances 
inherent in the display hardware (such as sensor and meter noise). They may also be used to 
represent resolution limitations of the human’s visual system plus random response behavior aris- 
ing from signal/noise limitations of the human brain’s central processing mechanism (refs. 48 
and 49). 


(6) Handling Qualities 

Pilot-vehicle analysis has been applied extensively to the study of vehicle handling characteristics 
(refs. 50, 51, 52, 53, and 54). Several approaches have been explored. Although none has achieved 
universal application, some general observations can be made. The pilot’s rating of a vehicle’s 
handling qualities is influenced by the nature of the open-loop response characteristics of the 
vehicle, by the closed-loop system performance that can be achieved in various task situations, 
and by the nature of the response strategy required of the pilot. It has been found, for example, 
that pilot ratings worsen as tracking error increases and as the lead that must be generated by the 
pilot increases. Some success has been achieved in modeling the relationship between pilot rating, 
pilot lead, and system performance. Since pilot-vehicle models are capable of representing both 
the informational characteristics of the display and the perceptual limitations of the human, these 
models should prove useful in exploring the relationship between display parameters and vehicle 
handling qualities. 

(7) Effects of System Failure 

By investigating the effects of sudden changes in the display and system parameters on pilot be- 
havior and system performance, one can predict the ability of the pilot to recover from a failure 
condition. Accordingly, the suitability of the display configuration in a situation of this sort can 
be evaluated (ref. 55). 

(8) Sensitivity to Pilot Strategy 

The sensitivity of closed-loop system performance to changes in the pilot’s response strategy can 
be predicted. For example, one can explore the effects of a constant bias in one or more of the 
pilot’s response parameters, or one can look at the effects of an increase in the magnitude of 
random fluctuations in these parameters. Although this aspect of the model’s predictive capa- 
bility cannot readily be verified experimentally (since the pilot will usually attempt to select the 
appropriate response strategy with a minimum of random response activity), predictions of this 
sort should prove useful in the evaluation of system controllability and pilot acceptance. 
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3. CRITERIA 
3.1 System 

The display system shall provide (hr information needed l»v the astronaut to navigate and control 
the spacecraft within specified accuracies for all mission phases requiring him to do so. It shall be 
designed to permit the supervision and management of the performance of the automatic CN'C 
systems and related backup systems. Tin* displays* should also enable the operator to adjust auto- 
matic systems. 

TJie system should always provide some means (buttons, switches, etc.) that shows the applicable 
array of mission phases and control modes available*, plus the one that has been selected. Digitally 
coded keyboard entries as a primary means of selecting major control modes and mission phases 
shall be avoided. 

The display system should be designed so that system performance is relatively insensitive to the 
pilot’s information-processing and control strategies. 

The display system should allow the specified handling quality to he achieved. 

The redundancy in the display system shall he consistent with the reliability requirements of the 
mission. 

Wherever possible, where astronauts are involved in space flight of long duration, facilities 
should he provided for practice using the displays and controls that will permit the maintenance 
of performance efficiency. 

Typical astronaut users should he consulted and participate actively in all phases of the display 
design process so that user requirements can he meaningfully taken into account. 


3.2 Emergency Performance 

Information shall be presented to aid the detection of and the recovery from failures in the ONO 
system. The display system design should he such that manual takeover from automatic control 
can be accomplished with acceptable transients. Displays of emergency conditions should he de- 
signed to permit information interpretation to he as* rapid as is necessary to make possible- a 
timely response. 

SS here practical, automatic* controls should he designed to perform maneuvers in the same way as 
the pilot, using the same displays. This will minimize takeover transit if takeover is* required. 

Displays should fail in such a manner that no false display of information occurs during the fail- 
ure process of any part of the system. The failed display should indicate its inoperative status 
clearly and unambiguously. 
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Controls should be designed so that the relationships between all control-display movements are 
the “natural” or “expected” ones and no unnecessary mental process is required between compre- 
hension and response, so that control reversals will not occur during emergencies or in stressful 
situations. 

The display design should take into account the degradation of human performance which would 
result from the astronaut’s being subjected to environmental stress such as vibration, high accel- 
eration forces, hypoxia, etc. 


3.3 Display Integration 

Display should be such that the smallest number of crew members can perform all control and 
monitoring functions necessary to accomplish a safe return from any point in the mission. 

Control mode displays must always show what mode of guidance and control is being used even 
when some sort of switching and sequencing is performed under computer control. Momentary 
indications are not adequate. 

System integration factors such as power, weight, and size should be included in consideration 
of appropriate display designs and selection. 

Critical GNC displays should be located centrally, and nonessential displays should be removed 
in either position or time. 

Controls should be located to insure that continuous viewing of critical displays is possible. All 
controls and switches to be used in a critical maneuver should be located so that the astronaut 
does not have to move his eye far from the location of the critical displays. 

Displays and controls should be organized in some logical arrangement in order to facilitate 
accomplishment of complex procedures, both routine and emergency. 


3.4 Specific Display 

The tendency of a display to yield reading errors for one particular type of indication should be 
guarded against (bias errors). System design should be insensitive as far as possible to the effects 
of minor reading errors. Interpretation time should be minimized for the higher-priority displays. 
The display system should be designed to minimize occurrence of either (1) undesirable vestibular 
responses or (2) undesirable visual phenomena, such as apparent movement effects (known 
generically as the Phi phenomena, in which movement in the visual field is perceived without 
actual physical movement of the stimuli) or the autokinetic effect (in which, in the absence of a 
visual frame of reference, a point of light may be perceived as moving or drifting). 

Cockpit lighting and display brightness shall be such that all displays are fully legible irrespec- 
tive of brightness and direction of outside ambient light entering through cabin windows. The 
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Tin' displays should present sufficient information to prevent the exceeding of human or system 
tolerance's. 


Tin- human visual scanning: workload should lie minimized where real minimization does not 
contribute to increased display interpretation time and possible confusion between different 
instruments. 


The- performance tasks should, as far as possible, lie distributed appropriately between crew 
members if it can be arranged without compromising performance or requiring an excessive 
amount of equipment. Consideration should be given to rotating duty shifts since task splitting 
could had to functional weaknesses. When actively involved in system operations, each crew 
member on duty should have an approximately equal workload; and in emergencies, the over- 
load imposed on any one crew member should be minimized bv distributing the load to the 
other c rew members. 

Information should he presented so that the amount of processing required to arrive at an ap- 
propriate operator response should he minimized (techniques such as quickening and predic tion 
are examples of this'. Display processing rules should he as uniform as possible. Changes of 
rules between displays within tie* one panel should be eliminated if possible*. 

When tin- human operator most monitor vehicle performance under automatic control, higher- 
level information should lie prese nted to permit easy understanding of the syste m state; the dis- 
play should also contain information appropriate* for manual control of vehicle. 


4. RECOMMENDED PRACTICES 


4,1 System Considerations 









stage to the detailed development stages. For a general description of system analysis procedures, 
see reference 56. 

It is recommended that the baseline information requirements be determined by the following 
sequence of analysis steps. These steps should be performed to the level of detail necessary to 
ensure precise definition of the system display requirements. Each step may require several itera- 
tions before a final set of requirements is reached, and analytical models can play a role in deter- 
mining the requirements. An outline of tire development cycle is indicated in figure 6. 

4.1.1 Mission Analysis 

Mission analysis requires determining and stating as precisely as possible the purpose and goals of 
the system, and what will constitute the measures of system effectiveness. Details of required ac- 
curacies, reliabilities, and system performance criteria should be assembled at this stage. How- 
ever, data on reliability of pilots’ reading instruments is very limited and simulation is necessary 
to achieve even gross estimates. The mission analysis should include a statement of the environ- 
mental and time constraints accompanying mission performance. This analysis leads to a defini- 
tion of requirements that are expressions of obligations the system must fulfill to carry out its 
mission. Requirements are usually stated first qualitatively and then become increasingly more 
precise as system development proceeds. 

4.1.2 Development of Functional Flow Diagrams 

The next step is to perform and diagram the functional analysis based on the mission; i.e., to iden- 
tify the means by which elements of the mission can be accomplished, and then to relate these 
separate means with one another to form a diagrammatic structure of how the mission is to be 
accomplished, with particular emphasis on the man-machine interface. Such diagrams translate 
system requirements into functional terms, identify functional interfaces, and allow segmentation 
of the mission into smaller analysis units. 

4.1.3 Information Requirements 

A listing of the decisions required in the tasks allocated to the astronauts can now be made, and 
from this a list of information requirements can be drawn up. The list of information require- 
ments will serve as a general indicator of the types of display that are required for specific 
functions and subtasks. However, the listing alone will not lead to such a display specification; 
many other system factors will have an influence here. 

In this step, one needs to define the variables that should be displayed, the range and precision 
of these variables, the bandwidth the display has to cover, and the variable derivatives that need 
to be displayed. 

4.1.4 Task Allocation 

The tasks required to complete a function should then be decided upon, and these are allocated 
either to the human operator or to the hardware system. Those tasks requiring display inputs to 
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the human can then be established. Choice of functions should reflect a combination of the follow- 
ing: (1) judgment and intention based on similar systems; (2) dictates or constraints of the user; 
and (3) critical analyses, experiments, and simulation studies involving tradeoffs of alternative 
configurations of automatic and manual performance, and incorporating what is known about 
man, machine, and man-machine performance. Assigning functions in a particular system is not 
helped by a set of rules determining allocation. The method of attack is an iterative one based 
on many specific system development considerations (ref. 57). 


4.1.5 Time-Based Analysis 

The feasibility of presenting the required information to the human within his information pro- 
cessing and responding capabilities can be tested by using time-based analysis techniques (ref. 
58). This should be performed initially in a relatively gross way, but should eventually be refined 
and elaborated, using the types of computer-based simulation models described in reference 39. 


4.1.6 Application of Analytical Models 

Analytical models, including performance measures of information quality, are recommended for 
use if required to determine the effects on closed-loop man-vehicle systems. For example, it may 
be required in special cases where real-time manned simulation is not feasible or practical. In 
other cases, where conflicting results exist, an analytical rationale would help reconcile the 
differences. Specifically, it is recommended that human controller models (refs. 44 and 45) be 
utilized in evaluating the adequacy of the display design characteristics used to present flight con- 
trol information to the astronaut. A methodological procedure for flight control display system 
design is offered in references 23 and 59. The effects of varying relevant display parameters 
will provide more information on display system requirements (prior to experiment and simulator 
development) and indicate the advantages of competing types of control systems. 


These types of system analysis procedures should be carried out as early as possible in the systems 
development to provide indications of the types of displays systems that will yield the necessary 
levels of performance to enable successful completion of the mission. The system equipment re- 
quirements for several types of orbital missions under manual modes of control are discussed in 
reference 60. 


4.2 Degraded-Mode Analysis 

No panel display can be considered adequate unless it is subjected to a degraded-mode analysis 
on several levels. The loss of subsystem functioning should be considered at a number of analysis 
levels: (1) the change in information requirements, (2) the effects on task workload, (3) the im- 
plications for display panel layout, and (4) evaluation of the degraded effects in simulation on 
mission accomplishment. 
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4.3 Integrated Crew Performance 

The performance of tin* integrated team of astronauts should In* studied at several stages of 1 1 > r 
systems development. Earliest alloc ation should Ik* on the basis of expert opinion, which should 
then he subjected to evaluation using simulation models stub as those described in reference 39. 
Tin training required in order to perform certain groups of tasks- should also he considered, and 
tasks should be allocated so as to minimize the training requirements. 


4.4 Selection and Evaluation of Specific Displays 

Tin preceding analysis will serve as an input into the selection and/or design of specific display 
devices. Added considerations should include the display principles previously discussed and 
handbook data )V.g. ref. 121 to insure that the actual displays are In st coded. Such factors as dis- 
play sire, inde x design, si/c and type of numerals, and display sealing will be considered. 

The adequacy and completeness of information presentation should be examined through care- 
full)- designed experimental programs. Such validation should take place on several levels ranging 
from consideration of the adequacy and comparison of single displays- in subsystem performance 
to system evaluation in part- and full-task simulators. Quantitative descriptive measures such as 
speed and accuracy of response and error scores should he recorded and summarized in terms of 
means and standard deviations. Where relevant, the data will he analyzed according to estab- 
lished statistic al procedures to evaluate the statistical reliability of the results and to discover the 
relative importance of the experimental variables considered. (For a general reference on this topic, 
see reference fil l The expe rimental data will he obtained using experimental procedures which 
allow satisfac tory analysis of the data. Careful planning will he required to cast an experiment 
into a form that will permit a standard design to he used or to he modified to more closely 
meet the requirements of the- experiment. Good principles of experimental design will he applied. 

Variables should not he grouped together in the experime ntal conditions so that their direct ef- 
fect cannot he estimated (for example, in experiments with displays, the design should separate 
the* effects of the control cli.iraetc risties of the task from the quality of the* displays used). Large 
enough samples of appropriate subjects should be used to insure the representativeness of the re- 
sults. and experimental subjects should he drawn from the population of actual user types. Where 
several variables arc* to he displayed on one multipurpose display device, it should he dete rmined 
that there is no ambiguity or confusion resulting from using the same device at the same location 
to display different information at diffe rent times. 

It is recommended that experiments be conducted with the following intentions in mind: (1) to 
evaluate the effect of a particular display configuration compared with expected performance (the 
normative model’; (2*i to form estimate’s of workload; (31 to collect basic human response data to 
be used as baseline inputs to discontinuous computer analyses for computing workload: (-11 to de- 
termine that combination of equipment parameters which would lead to satisfaction of required 
performance criteria. 


4.5 Workload Estimates 


Attention should be focused throughout systems development on the workload imposed on the 
astronaut. It is recommended that the following techniques be considered for use in evaluation 
of this workload. 

Expert opinion can be relied upon very early in the development cycle from panels of both ex- 
perts and users in the field of human factors. However, users may not always react favorably 
at first to novel display developments. 

As system development concepts become more specific, peaks of workload or stages of overload 
should be identified by applying discontinuous analysis, time-line analyses (ref, 37), or man- 
machine simulation models (ref, 39). Various system configurations and procedures should be 
subjected to this analysis in order to evaluate competing subsystems and to perform an initial al- 
location of duties to the various crew members. 

As equipment configurations are selected and mockups developed, application of procedures for 
estimating workload experimentally are recommended for verifying that the display system and 
procedures generally allow each crew member to maintain spare mental capacity for meeting 
emergencies or deviations from standard procedures. The recommended procedure is to obtain 
estimates of spare mental capacity by recording the astronaut’s ability to perform a subsidiary 
task simultaneously with allocated system tasks (refs. 29 and 32). In selecting such an additional 
task, the following desirable properties should be remembered: 

(1) It should be “wide-band,” i.e., should measure spare capacity over a wide range 

(2) It should yield efficient measures and be reliable over short periods of time 

(3) It should require minimum learning 

(4) It should be quantifiable, in terms of a suitable metric. 

The visual scanning workload should be measured by recording eye-movement patterns so that 
the layout of instruments on the display panel can be evaluated, and changes in panel layout 
incorporated in the design to minimize this scanning load (refs, 41 and 46), 

The following two general rules can be applied to improving panel layout (ref, 62): (1) The 
greater the probability that a display will be fixated, the more centrally in the visual field it 
should be fixated; and (2) Tire greater the probability of transition between two signals, the closer to- 
gether they should be displayed. Methods for recording eye movements are described in refer- 
ences 63 and 64, 

Recording visual scanning patterns of the astronaut can also shed some further light on the in- 
formation requirements of the user and the strategies the astronaut is using to monitor his display 
system (refs, 62 and 65), 
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Of these methods of obtaining workload estimates, export opinion represent 1 ; the simplest and 
least expensive method, but is most restric tive in terms of detail and validity. The disenntinuniis 
analysis techniques can Ik* applied prior to the ac tual produc tion of moekups or simulators. If 
can he used to evaluate a number of different configurations, and the level of analysis detail in 
this technique can he altered by changing the basic time unit considered. These two procedures 
are more relevant to the early stages of design. The procedures of estimating spare mental ca- 
pacity and visual scanning workload arc* more relevant to tin* later design stages and. applied 
to a full task simulation, have the highest face validity. Tin* procedures may have to be iterated 
several times before a final design is selected. 


4.6 Simulation 

Any display development would be incomplete, particularly in complex vehicle systems, with- 
out adequate simulation evaluation. In the early phases of the program, simple, single-task simu- 
lations should he sufficient. At the later stages, simulation must he used to indicate whether the 
crew members are able to utilize the information from the display system to perform the mission 
with a high enough reliability. As the syste m develops, simulation should heroine more and more 
a full-task simulation. Where the astronaut is required to combine visual information from outside 
space with display system information, it is recommended that the simulation incorporate visual 
scenes from outside the cabin with good fidelity. 

Experiments to de termine the- ability of the astronaut to dete ct and re cover from failures using 
the 1 proposed configurations arc recommended. The experimental plan for these experiments 
should lie aimed at (11 obtaining data on whether the human operator can use the displays at 
his disposal rapidly enough to permit recovery from the failure, and (21 after failure, whether 
the degraded or standby display-control system possesses adequate characteristics. These can he 
evaluated by workload measurement, simulator performance, and applic ation of human response 
analytical models. 

If there are any questions about the efficacy of the display-control relationship, the se relation- 
ships should he evaluated by measuring population stereotypes* for all display-control pairings, 
using such techniques as primitive moekups, before selecting the* operational relationships. 
Wherever possible, uniform rules relating display and controls should be striven for. For a general 
review of population stereotypes, see refe rence 63. However, the* fact that the astronaut user is 
highly skilled and represents a small user population means that the de sign can he tailored to 
meet his spec ific needs. 

Visibility tests should he performed in a markup to insure* adequate display visibility under all 
ambient lighting conditions that can be expected during the performance* of the mission. 
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NASA SPACE VEHICLE DESIGN CRITERIA 
MONOGRAPHS ISSUED TO DATE 


SP-8001 (Structures) 
SP-8002 (Structures) 
SP-8003 (Structures) 
SP-8004 (Structures) 
SP-8005 (Environment) 
SP-8006 (Structures) 
SP-8007 (Structures) 
SP-8008 (Structures) 
SP-8009 (Structures) 
SP-8010 (Environment) 
SP-801 1 (Environment) 
SP-8012 (Structures) 
SP-8013 (Environment) 

SP-8014 (Structures) 

SP-8015 (Guidance and 
Control) 

SP-8016 (Guidance and 
Control) 

SP-8017 (Environment) 

SP-8018 (Guidance and 
Control) 

SP-8019 (Structures) 

SP-8020 (Environment) 

SP-8021 (Environment) 

SP-8022 (Structures) 

SP-8023 (Environment) 

SP-8024 (Guidance and 
Control) 

SP-8025 (Chemical 
Propulsion) 

SP-8026 (Guidance and 
Control) 


Buffeting During Atmospheric Ascent, revised November 1970 
Flight-Loads Measurements During Launch and Exit, December 1964 
Flutter, Buzz, and Divergence, July 1964 
Panel Flutter, July 1964 

Solar Electromagnetic Radiation, revised May 1971 

Local Steady Aerodynamic Loads During Launch and Exit, May 1965 

Buckling of Thin-Walled Circular Cylinders, revised August 1968 

Prelaunch Ground Wind Loads, November 1965 

Propellant Slosh Loads, August 1968 

Models of Mars Atmosphere (1967), May 1968 

Models of Venus Atmosphere (1968), December 1968 

Natural Vibration Modal Analysis, September 1968 

Meteoroid Environment Model — -1969 (Near Earth to Lunar Surface), March 
1969 

Entry Thermal Protection, August 1968 

Guidance and Navigation for Entry Vehicles, November 1968 

Effects of Structural Flexibility on Spacecraft Control Systems, April 1969 

Magnetic Fields — Earth and Extraterrestrial, March 1969 
Spacecraft Magnetic Torques, March 1969 

Buckling of Thin-Walled Truncated Cones, September 1968 

Mars Surface Models (1968), May 1969 

Models of Earth’s Atmosphere (120 to 1000 km), May 1969 

Staging Loads, February 1969 

Lunar Surface Models, May 1969 

Spacecraft Gravitational Torques, May 1969 

Solid Rocket Motor Metal Cases, April 1970 

Spacecraft Star Trackers, July 1970 
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SP-WC" fC.uidanrr anti 
Control! 

SP-S07S fCntdanee and 
Control! 


SP-S029 (Structures! 


SP-S010 (Structures! 

SP-S011 (Structures! 

SP-Mli: fSt pictures! 

SP-SOl! (Coidancr and 
Conti oil 

SP-SOA! (Coidancr and 
Control' 

SP-S011 (Structure -0 
SP-VHO fCuidance and 

Control! 

SP-SOTT (environment! 
SP-S01S fFiivirnnment! 

SP SO',9 (Chcmiral 
Propulsion! 

SP-SO JO (Structures! 

SP-SO!) (Chemical 
Pliipulsii lit! 

SP-S0-I2 (Structures! 

SP-SO n t Sti nctnres' 

SP-SO M (Structures! 

SP-SO Jo (Structures! 

SP-SO 10 (Structures! 

SP-SO 17 (Outdance and 
Control! 

SP-SO IS 'Chemical 
Piopnlsion! 

SP S0 S9 (Environment! 

SP-SOnO (Structures! 

SP SOM (Chemical 
Propulsion! 


Sp.it-4 i-i.ifl Radiation Torques-, October 1909 
Entry Vehicle Contiol, N’nvemher 19(59 

A« -rodvnamic and R<M-l.i-».F\hans‘t Heating Dining Launch and Awnt, May 
I 909 

Transient lauds From linns! Excitation. February 19(59 
Slosh Suppression, M.«v 1 9(5*1 

Budding of Tliiu -Walled Douhlv Curved Sheik August 19(59 
Spacecraft Kartli flori/on Sensors. Deecmln-r 1 9f59 

Spacecraft Mass Expulsion Torques, Di-mnlicr 19(59 

Wind lauds During Ascent, June lf)7ft 

Effects of Siuicliif.il Flexihilitv on I.auncli V«-liiclc Control Systems, February 
197(1 

Assessment and Control of Spacecraft Magnetic Fields. Scptcmlicr 1970 

Meteoroid Fnviroiuncnt Model --1970 f Inter -planetary and Planetary!. 

Oi iol.er 1970 

Solid Rocket Motor Performance Analysis and Piediction. May 1971 

Fracture ( iontrol of Metallic Pressure \ ess-els. May 19.0 
Captive-Fired Testing of Solid Hut l i t Motors. March 19.1 

Meteoroid Damage Assessment. May 1970 
Design Development Testing, May 1970 
Qnalifii at ion listing. May 1970 
Acceptance Testing. April 1970 

Landing Impart Attenuation For Non Sm face Planing Landers. April 1970 
Spacecraft Sun Sensors. June 1970 

Liquid Bucket Engine Tm hopunip Bearings, March 1971 

The I'ai ill’s Ionosphere. March 1971 
Stiuetnr.d Vibration Piedietion. Jinn- 1970 
Solid Hoelet Motor Igniters. March 1971 


as 



SF-8G52 (Chemical 
Propulsion) 

SP-8053 (Structures) 

SP-8054 (Structures) 

SP-8055 (Structures) 

SP-8056 (Structures) 

SP-80S7 (Structures) 

SP-8058 (Guidance and 
Control) 

SP-8059 (Guidance and 
Control) 

SP-8080 (Structures) 

SP-8061 (Structures) 

SP-8062 (Structures) 

SP-8063 (Structures) 

SP-8065 (Guidance and 
Control) 

SP-8066 (Structures) 

SP-8067 (Environment) 

SP-8068 (Structures) 

SP-8069 (Environment) 

SP-8070 (Guidance and 
Control) 

SP-8071 (Guidance and 
Control) 

SP-8072 (Structures) 

SP-8074 (Guidance and 
Control) 

SP-8077 (Structures) 

SP-8078 (Guidance and 
Control) 

SP-8082 (Structures) 
SP-8084 (Environment) 
SP-8085 (Environment) 


Liquid Rocket Engine Turbopump Inducers, May 1971 

Nuclear and Space Radiation Effects on Materials, June 1970 
Space Radiation Protection, June 1970 

Prevention of Coupled Structure-Propulsion Instability (Pogo), October 1970 
Flight Separation Mechanisms, October 1970 

Structural Design Criteria Applicable to a Space Shuttle, January 1971 
Spacecraft Aerodynamic Torques, January 1971 

Spacecraft Attitude Control During Thrusting Maneuvers, February 1971 

Compartment Venting, November 1970 

Interaction With Umbilicals and Launch Stand, August 1970 

Entry Gasdynamic Heating, January 1971 

Lubrication, Friction, and Wear, June 1971 

Tubular Spacecraft Booms (Extendible, Reel Stored), February 1971 

Deployable Aerodynamic Deceleration Systems, June 1971 
Earth Albedo and Emitted Radiation, July 1971 
Buckling Strength of Structural Plates, June 1971 
The Planet Jupiter (1970), December 1971 
Spaceborne Digital Computer Systems, March 1971 

Passive Gravity-Gradient Libration Dampers, February 1971 

Acoustic Loads Generated by the Propulsion System, June 1971 
Spacecraft Solar Cell Arrays, May 1971 

Transportation and Handling Loads, September 1971 
Spaceborne Electronic Imaging Systems, June 1971 

Stress -Corrosion Cracking in Metals, August 1971 

Surface Atmospheric Extremes (Launch and Transportation Areas), May 1972 
The Planet Mercury (1971), March 1972 
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